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ABSTRACT 

The Missouri Department of Elementary and Secondary 
Education uses state-developed, criterion-referenced tests for the 
purpose of evaluating programs funded by Chapter 1 of the Elementary 
and Secondary Education Act. The agency's efforts to obtain approval 
from the U.S. Department of Education (USDE) to use state norms for 
evaluation purposes are described, and evidence is presented to 
demonstrate that the state tests meet the USDE criteria for approval. 
The second section of the paper describes the innovative and 
efficient processes that Missouri uses to collect, aggregate, and 
report evaluation data to the local education agencies. The Missouri 
Mastery and Achievement Tests and the First-Grade Reading and 
Mathematics Test, the two tests developed for Chapter 1 evaluation, 
are appropriate and efficient for program evaluation throughout most 
of the grade-level continuum. Both meet or exceed the USDE 
requirements. Electronic transmission of information, a feature of 
the Missouri system, from collection of pretest scores to the 
generation and communication of data and results saves time and 
effort for local Chapter 1 personnel. Four appendixes provide sample 
reports generated by the testing process and a local school report 
form. Eight tables present evaluation findings. (Contains 7 
references .) (SLD) 
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Abstract 



This paper explains how a state education agency (SEA) uses state-developed, 
criterion-referenced achievement tests to evaluate Chapter 1 programs. The 
paper describes the SEA's efforts to obtain approval from the United States 
Department of Education (USDE) to use state norms for evaluation purposes, 
and it presents evidence demonstrating that the state tests meet the USDE 
criteria for approval. The paper also describes the innovative reports and 
efficient procedures that the SEA employs to collect, aggregate, and report 
evaluation data to local school districts. 
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Using Criterion-Referenced Tests to Evaluate Chapter 1 Programs: 

A Lesson from Missouri 



The purpose of this paper is to explain how a state education agency, 
the Missouri Department of Elementary and Secondary Education (MDESE), 
uses state-developed, criterion-referenced tests for the purpose of evaluating 
programs funded by Chapter 1 of the Elementary and Secondary Education 
Act. The paper is divided into two sections. The first section presents 
evidence demonstrating that the Missouri tests meet the criteria established 
by the United States Department of Education (USDE) for the use of state 
norms in the evaluation of Chapter 1 programs. The second section describes 
the innovative and efficient processes that MDESE uses to collect, aggregate, 
and report evaluation data to local education agencies (LEAs). 

Use of State-Normed, Criterion-Referenced Tests In Evaluation 

Description of State Tests 

The Missouri Mastery and Achievement Tests (MMAT) represent the 
cornerstone of Missouri's statewide assessment program. The MMAT battery 
measures educational objectives, referred to as Key Skills, and consists of 34 
criterion-referenced tests assessing student performance in grades 2 through 
10. Tests for grade 2 cover Reading, Language Arts, and Mathematics. Tests 
for grades 3 through 10 cover Reading, Language Arts, Mathematics, Science, 
and Social Studies. At each grade, there are at least two equivalent test forms. 
The Firsi-Grade Reading and Mathematics Test (First-Grade Test), also a 
criterion-referenced instrument, measures educational objectives in Reading, 
Language Arts, and Mathematics that are linked to the grade 2 Key Skills 
measured by the MMAT. Eventually, there will be two equivalent forms of 
the First-Grade Test, although at the present time only one form is available. 

State regulations, based on the Missouri Excellence in Education Act of 
1985 (House Bill 463), require all school districts to administer the MMAT 
battery or another approved measure of the Key Skills each year to students in 
two non-consecutive levels in the grade span 2 through 6 and to students in 
two non-consecutive levels in the grade span 7 through 10. The battery is 
administered in the spring, so that it can be used for summative evaluation 
purposes, although districts may also administer it in the fall. 

The MMAT battery and the First-Grade Test may be appropriately used 
to evaluate the effectiveness of Chapter 1 programs throughout most of the 
grade-level continuum. Corresponding subject tests are linked vertically 
across all grades on the basis of the common core of content measured. The 
MDESE utilizes a spring-to-spring evaluation cycle for Chapter 1 programs. 
At grades 2 through 10, the MMAT may be administered to end-of-year 
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students in order to obtain pretest scores to compare with posttest data 
obtained in the following spring. At grade 1, the First-Grade Test may be 
administered to end-of-year students in order to obtain pretest scores to 
compare with grade 2 MMAT posttest scores obtained in the following spring. 
(School districts are not required to administer the First-Grade Test, but they 
are encouraged to utilize it in the identification of students who are eligible 
for Chapter 1 services. If districts are using the MM AT at grade 2 to evaluate 
the effectiveness of Chapter 1 programs, they must use the First-Grade Test to 
obtain pretest data.) 

From 1987 through 1990, the MMAT yielded Chapter 1-usable scores 
referred to as estimated comparable national percentile ranks. These 
estimated norms were obtained by equating raw scores on MMAT subtests to 
raw scores on corresponding subtests from a nationally normed achievement 
battery. This equating procedure, described in detail by Schattgen and 
Osterlind (1988), allowed districts to engage in dual-purpose testing and to 
allocate resources to the administration of the MMAT, which, as a criterion- 
referenced battery, has more instructional utility than its norm-referenced 
counterparts* The results of studies investigating the technical properties of 
the estimated comparable national percentile ranks suggested that they were 
valid for making eligibility decisions (Schattgen & Osterlind, 1989) but were 
not as reliable as might be desired (Schattgen, 1990b). Consequently, the 
MDESE was pleased when federal regulations were modified in order to allow 
the use of local (state or district) norms in Chapter 1 evaluations (USDE, 1990). 

USDE Criteria for Approval of State Norms 

The USDE (1990) stipulates that local rather than national norms may 
be used for Chapter 1 evaluation purposes, if the achievement test used meets 
certain criteria. The agency identifies (p. 9) "two areas of concern in 
developing state norms for use in evaluation: the validity of th' dtate tests 
for measuring typical Chapter 1 instructional objectives," referred to as 
"content validity," and the "representativeness of the norms." The salient 
points of the criteria associated with the respective areas are given below. 

Content Validity 

According to USDE (1990) requirements governing the use of state 
norms for Chapter 1 evaluation purposes, the state must show that 

each level of its test is a valid measure of the subject matter relevant to 
Chapter 1 evaluation, namely reading, mathematics and other 
language arts content typically measured by total tests and subtests of 
norm-referenced achievement tests used in the evaluation of Chapter 1 
programs. Content validity must be demonstrated using the 
correlation between the state test and any nationally normed 
achievement test. . . . Evidence of adequate correlation would be a 
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correlation between total scores of the state test and the selected 
nationally normed test of at least 0.75, and at least 0.70 for subtests, (p. 
9) 

The USDE regulations postulate that correlations should be computed on a 
sample of at least 200. 

Representativeness of Norms 

In order to be in compliance with USDE policies (1990) regarding the 
use of state norms for Chapter 1 evaluation purposes, the state must present 
evidence that the 

norms developed are representative of the achievement levels of all 
students in the population to be tested. Such evidence would include a 
description of the probability sampling design employed and a 
comparison of the relevant characteristics of the students who 
constitute the norms with the characteristics of the student 
population* ... In order to ensure that state norms are quite stable, the 
sample size for any one grade level should be no less than 2, 000. . . . 
(p. 9) 

Pretest-posttest gains calculated for Chapter 1 students that are 
based on state norms should be consistent with the NCE gains for these 
students based on national norms. For each level of the state test, a 
subsample of at least 200 students should be administered a nationally 
normed test. The standard deviation of the MCE scores on the 
nationally normed test should be calculated. If it is different from 
21 .06, the pretest-posttest gains should be expressed in standard 
deviation units (using the state norming distribution) and then 
multiplied by 21.06. (p. 10) 

MDESE Application for Approval of State Norms 

The MDESE filed an application (Schattgen, 1990a) requesting the 
USDE's approval to use the state norms yielded by the MMAT and the First- 
Grade Test for the purpose of evaluating Chapter 1 programs. The application 
and the addendum to it presented evidence, which is given below, 
demonstrating how the MMAT and the First-Grade Test meet the USDE 
(1990) criteria for approval of state norms. 

Content Validity of State Tests 

The MMAT and the First-Grade Test demonstrate acceptable content 
validity as it was defined in 1990 by the USDE. This conclusion is based on 
the analysis of data resulting from concurrent administrations of the two 
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Missouri tests and two nationally normed batteries to representative samples 
of Missouri students in Spring 1990. The nationally normed tests 
administered were the Iowa Tests of Basic Skills (ITBS) at grades 1 through 8 
and the Tests of Achievement and Proficiency (TAP) at grades 9 and 10. 

Pearson product-moment correlation coefficients indicating the 
relationships between corresponding subject-test raw-score distributions 
yielded by the MM AT and the ITBS at grades 2 through 8 and the MMAT and 
the TAP at grades 9 and 10 are shown in Table 1. Pearson product-moment 
correlation coefficients indicating the relationships between corresponding 
subject-test raw-score distributions yielded by the First-Grade Test and the 
grade-1 ITBS are also shown in Table 1. The coefficients were computed using 
data from subsamples of the probability sample on which the test was normed 
(see description of norming sample below). The number of examinees taking 
each pair of tests (the n used to compute each correlation) is given in the 
table. Note that the n for each subsample exceeds 200, the n required for 
approval. 

The coefficients indicate that, in general, there are strong relationships 
between subject-test raw scores on the MM AT / First-Grade Test and the 
ITBS/TAP. At all grades and subjects except grade-1 reading and language 
arts, the coefficients exceed the criterion of .75 needed for approval. At .734, 
the grade-1 reading coefficient is very close to the criterion; at .636, the grade-1 
language arts coefficient is slightly lower than the criterion. 

Representativeness of State Norms 

Types reported. 

For the purpose of conducting Chapter 1 program evaluations, both the 
MMAT and the First-Grade Test yield a state percentile rank and a 
corresponding normal curve equivalent (NCE) score in each Chapter 1 area 
(Reading Comprehension, Language Arts, and Mathematics). Within 
Mathematics, a state percentile and a corresponding NCE are reported for 
basic skills (computation) and also for advanced skills (application and 
problem solving). The percentiles and NCEs are within-group norms 
reflecting an examinee's performance relative to the sample on which each 
test is annually normed. 

Representativeness. 

The norming samples for the MMAT and the First-Grade Test are 
groups of examinees representative of the Missouri student population. At 
each grade, students in the sample are selected for inclusion in the sample 
using a probability design, specifically the stratified-random-cluster technique. 
Two stratification variables are used to determine the characteristics of the 
sample: school-district size and school-district type. School buildings within 
the districts represent the clusters. 
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There are 11 sampling categories based on he stratification variables. 
Table 2 presents a description of each category. In each grade in each category, 
a building has a random chance of being selected for inclusion in the sample. 
Table 3 shows the proportion of the Missouri student population in each 
grade in each category. 

In order to annually norm the MMAT and the First-Grade Test, a new 
sample is drawn for each spring administration. Approximately one-tenth of 
the total student population is selected for inclusion in the total sample. This 
proportion is larger than necessary in order to compensate for attrition in the 
sample due to unavoidable circumstances (e.g., classes are not scheduled to be 
in session at the building during the specific week that the sample is to be 
tested). 

Table 4 presents the number of students in each grade in each category 
selected for inclusion in the Spring 1990 sample. (The number in each cell 
represents the corresponding proportion of the population that is shown in 
Table 3.) As previously noted, not all students selected for inclusion in the 
sample are actually tested as part of the sample due to a variety of 
unavoidable circumstances. However, the actual number of students tested 
in the sample in each grade, also shown in Table 4, exceeds 2000, the number 
required for approval. 

Tables 5 through 7 present MMAT and First-Grade Test data for the 
Spring 1990 correlation and norming samples and for the Spring 1990 
population. Raw-score means and standard deviations of the reading tests, 
language arts tests, and mathematics tests are shown in Tables 5, 6, and 7, 
respectively. These data provide evidence of the representativeness of the 
correlation and norming samples because sample and population values for 
corresponding grades and subjects are very similar. Note that the number of 
examinees in each correlation and norming subsample exceeds the number 
required for approval (200 and 2000, respectively). 

Table 8 presents data from the Spring 1990 correlation sample for the 
nationally normed tests used to validate the MMAT and the First-Grade 
Pleading Test. Standard deviations of NCE score distributions for the reading, 
language arts, and mathematics subtests of the Iowa Tests of Basic Skills 
(ITBS) and for the reading and mathematics subtests of the Tests of 
Achievement and Proficiency (TAP) are shown. Most of the the ITBS fT AP 
NCE standard deviations are comparable to the national standard of 21.06, 
although only one value (grade-8 mathematics) equals 21.0. (The standard 
deviations range from 17.2 to 21.6; the median standard deviation is 18.95, 
and the mean standard deviation is 19.2.) Consequently, the MDESE will 
adjust NCE gains based on the state norms for all grade-level subject tests 
except grade-8 mathematics in accordance with how the corresponding 
ITBS/TAP NCE standard deviation differs from 21.06. 
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Table 2 
Sampling Categories 



Category Description 



A western urban (Kansas City) 

B eastern urban (St. Louis) 

C southwestern urban (Springfield) 

D out-state, mid-sized urban; university-dominated economy 

E out-state, mid-sized urban; industry-dominated economy 

F extreme southeastern rural ("boot-heel" area); agriculture-based 

economy 

G northern rural; agriculture-based economy 

H southwestern rural; agriculture-based economy 

I southeastern rural; timber/ mining-based economy 

J western suburban (Kansas City suburbs) 

K eastern suburban (St Louis suburbs) 
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Table 5 



Raw-Score Statistics jur First-Grade Test/MMAT Reading Tests, Spring 1990 

Administration 





Correlation Sample 


Norming Sample 


Population 


Grade 


Mean 


Std. Dev. 


Mean 


Std. Dev. 


Mean 


Std. Dev. 


1 


30.8 




6.6 


32.0 


*±f±L I 


5.9 


31.5 


6.2 

28,394 


2 


24.2 


I,/ / Z 


6.6 


25.1 


A AHA 


6.0 


25.5 


5.7 

42,674 


3 


40.5 


1 188 


9.4 


42.6 




8.3 


42.7 


8.2 

51,121 


4 


34.6 




10.8 


38.7 


4 865 


9.4 


39.0 


9.2 

44,136 


5 


34.9 


788 


8.4 


35.8 


4,762 


7.9 


35.9 


7.o 

44,245 


6 


38.3 


1,169 


9.1 


41.1 


4,673 


7.7 


40.7 


8.1 

49,221 


7 


39.4 


1,050 


11.2 


40.8 


4,209 


10.9 


41.9 


10.6 

40,007 


8 


42.5 


975 


10.3 


43.8 


5,160 


10.0 


43.9 


9.8 

47,941 


9 


41.9 


593 


10.3 


43.3 


3,921 


9.8 


43.5 


10.0 

34,853 


10 


44.1 


1,294 


9.0 


44.2 


4,693 


8.8 


43.8 


9.0 

44,254 



Note. The n/N is presented below each set of statistics. 



16 

ERIC 



11 



Table 6 



Raw-Score Statistics for First-Grade Test/MMAT Language Arts Tests, Spring 1990 

Administration 





Correlation Sample* 


Norming Sample 


Population 


Grade 


Mean 


bto 


. Dev. 


Mean 


Std. Dev. 


Mean 


Did. L/GV. 


1 


21.2 


24o 


3.8 


20.8 


4,411 


4.0 


20.4 


4.2 


2 


30.5 


1,704 


9.2 


32.3 


4,604 


8.5 


33.0 


8.2 

AO CJ7A 


3 


30.7 


1,124 


7.4 


31.8 


5,018 


6.4 


31.7 


6.5 

51 1 91 


4 


24.6 


1,121 


7.5 


25.9 


4,865 


6.9 


26.2 


6.9 

AA 1 f \£ s 


5 


28.6 


l,OU/ 


6.6 


30.2 


4,762 


5.7 


30.4 


5.6 

AA OAX 


6 


30.5 


1,154 


8.3 


32.2 


4,673 


7.4 


31.6 


7.6 

49,221 


7 


35.7 


1,223 


9.1 


36.9 


4,209 


8.6 


37.7 


8.4 

40,007 


8 


37.7 


1,152 


10.5 


38.6 


5,160 


9.9 


38.4 


9.9 

47,941 


9 








37.8 


3,921 


9.5 


37.9 


9.6 

34,853 


10 








37.1 


4,693 


9.4 


36.7 


9.4 

44,254 



Note. The n/N is presented below each set of statistics. 

* TAP Language Arts subtest was not administered to correlation sample at grades 9 
and 10. 
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Table 7 



Raw-Score Statistics for First-Grade Test/MMAT Mathematics Tests, Spring 1990 

Administration 





Correlation Sample 


Norming Sample 


Population 


Grade 


Mean 


Std. Dev. 


Mean 


Std. Dev. 


Mean 


Std. Dev. 


1 


54.6 


589 


4.9 


54.7 


4,411 


5.0 


54.1 


5.5 

28,249 


2 


25.9 


1,793 


5.5 


26.6 


4,604 


4.9 


26.8 


4.7 

42,628 


3 


56.5 


1,215 


9.9 


57.8 


5,018 


8.8 


57.6 


8.9 

51,181 


4 


39.5 


1,269 


8.5 


40.6 


4,865 


7.6 


41.3 


7.4 

44,265 


5 


38.0 


1,145 


11.5 


40.8 


4,762 


10.8 


41.0 


10.7 

44,202 


6 


7A ^ 


1,192 


19.1 


77 A 


4,673 


16.7 


7^ 1 
/D.l 


17 7 

49,254 


7 


50.4 


887 


18.1 


54.4 


4,209 


18.2 


56.9 


18.0 

39,951 


8 


62.0 


1,320 


20.7 


66.2 


5,160 


18.4 


65.9 


18.2 

47,998 


9 


38.0 


1,383 


13.2 


39.8 


3,921 


12.7 


40.3 


13.1 

34,909 


10 


57.3 


1,238 


17.7 


57.7 


4,693 


17.0 


57.2 


16.9 

44^32 



Note. The n/N is presented below each set of statistics. 
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Table 8 

Standard Deviations of Normal Curve Equivalent Scores for ITBS/TAP Tests, Spring 

1990 Administration 



Subject 



Grade 


Reading 


Language Arts* 


Mathematics 


1 


19.8 


19.7 


18.7 




562 


248 


589 


2 


20.7 


19.0 


20.2 




1,772 


1,704 


1,793 


3 


18.3 


18.5 


20.2 




1,188 


1,124 


1,215 


4 


17.2 


18.8 


18.5 




1,252 


1,121 


1,269 


5 


17.7 


19.4 


20.0 




788 


1307 


1,145 


6 


17.4 


18.6 


20.1 




1,169 


1,154 


1,192 


7 


18.0 


18.4 


18.5 




1,050 


1,223 


887 


8 


18.9 


20.1 


21.0 




975 


1,152 


1320 


9 


19.4 




18.6 




593 




1,383 


10 


21.6 




20.0 




1,294 


19 


1,238 





Note. The correlation sample n is presented below each standard deviation. 

* TAP Language Arts subtest was not administered to correlation sample at 
grades 9 and 10. 
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Collection and Aggregation of Evaluation Data and Reporting of Results 

Using MMAT for Chapter 1 Purposes 

The MDESE encourages all Chapter 1 programs in Missouri to 
coordinate their testing efforts with regu r classroom and district programs. 
To facilitate this coordination, the Chapter 1 office at the MDESE realigned 
evaluation guidelines and procedures to allow local education agencies to use 
the MMAT battery, which is criterion-referenced and measures the Key Skills, 
for Chapter 1 evaluation purposes. The spring-to-spring annual evaluation 
cycle allows for a single test administration for selection and /or evaluation 
purposes, reduces the testing burden on schools districts, and provides 
accurate and timely information on the statewide Chapter 1 population and 
its relationship to the total student population. (See MDESE, 1991a, for a 
complete description of policies and guidelines that apply to Chapter 1 
programs in Missouri.) 

MMAT Chapter 1 Reports 

To promote the use of MMAT results for Chapter 1 purposes, the 
MDESE offers two reports: The Chapter 1 Eligibility List and the Chapter 1 
Pre/Post Evaluation Report These reports, depicted in Appendices A and B, 
respectively, are described below. 

Eligibility list. 

The Chapter 1 Eligibility List shows all students in a grade in a building 
who are eligible, based on MMAT results, to receive Chapter 1 services. The 
standards for eligibility that are applied to students taking the MMAT in the 
spring reflect the grade placement for the next school year during which 
services are to be received. For each Chapter 1 program area, a student's 
eligibility status as well as his/her state percentile rank (referred to as the 
Chapter 1 eligibility rank) and corresponding NCE are shown. Students are 
listed in ascending order according to the Reading percentile rank. 

Note that this report shows performance in basic and advanced skills 
within Mathematics. (In Mathematics, basic skills involve computation, 
while advanced skills involve application and problem solving.) In Reading, 
advanced skills involve comprehension and are represented by the score 
reported, A score is not reported for basic skills in Reading, and scores are not 
reported for basic and advanced skills in Language Arts. 

A dotted line appears after the name of the last student eligible for 
services in Reading. Students listed below the dotted line may be eligible for 
services in Language Arts and/or Mathematics but not Reading. There is a 
space on the right side of the report to indicate a change in a student's status 
for receiving Chapter 1 services. The unduplicated number of educationally 
deprived students listed on the report appears at the end of the list. 
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Evaluation report. 

The Chapter 1 Pre/ Post Evaluation Report presents evaluation data for 
individual students that are ultimately aggregated to determine program 
effectiveness. This report lists all students designated on MMAT answer 
sheets as formally identified Chapter 1 participants having a previous year's 
MMAT score in the program area(s) in which they received services during 
the current academic year. For each student, the report presents the previous 
year's MMAT pretest score (which was entered on the answer sheet at the 
time of testing and scanned during the scoring process), the current year's 
MMAT posttest score, and the difference or gain score achieved by the student 
in each subject in which s/he received services. Pretest and posttest scores are 
presented as state percentile ranks and NCEs; gain scores are presented as 
NCEs. 

Aggregating and Reporting Evaluation Results to LEAs 

If there are inaccuracies in the MMAT data presented on the Pre/Post 
Evaluation Report, Chapter 1 personnel at the LEA return a corrected copy of 
the report to the Center for Educational Assessment at the University of 
Missouri-Columbia no later than July 1. On behalf of MDESE, the Center 
aggregates the evaluation data and provides feedback to the LEA via the 
MDESE Chapter 1 Program Impact Report. (Districts using a standardized test 
other than the MMAT for Chapter 1 evaluation, or using the MMAT but not 
participating in the optional Chapter 1 Pre /Post Evaluation Report, submit 
results on scannable forms.) 

Program Impact Report 

The MDESE Chapter 1 Program Impact Report indicates whether a 
building is identified for program improvement based on aggregate 
performance (MDESE, 1991b). Two types of Program Impact reports, building 
and district, are generated, and they are formatted identically. This report, 
shown in Appendix C, is divided into four major sections. 

• The first section contains descriptive information regarding 
student characteristics. The Chapter 1 student membership is reported 
by public and non-public schools. (A participant is a student who 
received any amount of Chapter 1 instruction.) The number of 
students who were reported as having either a pretest score or a 
posttest score, or both is shown in the column labeled Total 
Reported /Tested.' The numbers of students tested who were 
designated as having an IEP (Individualized Education Program) or 
being of LEP (Limited English Proficiency) are also shown. Aggregated 
totals for each category are presented in the bottom row. 
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• The Evaluation Results section shows the number of students 
with both pretest and posttest scores* The mean NCE and percentile 
for the pretest, the mean NCE and percentile for the posttest, and the 
mean and median NCE gain are shown for each of the following 
subject areas and skill levels: Overall and Advanced Reading; Overall, 
Advanced, and Basic Mathematics; and Overall Language Arts. 
Aggregated data for each category are presented in the bottom row. 

• The Program Improvement section repeats the total number of 
students for whom there are both pretest and posttest scores and 
indicates whether the building or district is targeted for Program 
Improvement by the mean or the median NCE gain. The district may 
choose which statistic (mean or median NCE gain) to use to determine 
the effectiveness of the Chapter 1 program, but that choice must 

be applied to all of the district's Chapter 1 buildings. 

• The last section lists: Grade level; Test Battery, Pretest and Posttest; 
Subtest; Test Level; Norming Dates; Test Dates; Days Between the 
Norming Dates and Test Dates; Net Days Difference Pretest and 
Posttest. If more than one test, subtest, or level is used within a grade 
in a school building, this fact is noted by separate lines within each 
grade. The last column of this section shows the percent of student 
retention from pretest to posttest. This is one index of student 
mobility within Chapter 1 classes. A large number in this column 
indicates low mobility since students pre-tested early in the program 
remained through the posttest date. 

Targeting LEAs for Program Improvement 

Chapter 1 programs are evaluated based on standardized test scores and 
progress toward meeting the desired outcomes specified in the Chapter 1 
application. In Missouri, a building is targeted for program improvement if 
there is not an aggregate gain of at least +1.0 NCE in basic and/or advanced 
skills (MDESE, 1991b). A building could also be targeted for program 
improvement if it fails to show progress toward meeting desired outcomes. 
Therefore, it is important for school districts to develop appropriate desired 
outcomes that can be easily measured and to select an appropriate test for use 
in evaluation. 

A local annual review must be conducted by the LEA to determine if 
standardized test aggregate performance requirements were met and if 
substantial progress toward meeting desired outcomes was made. This 
review determines whether a program improvement plan needs to be 
developed. Following the review, the district completes the Attachment A 
form, depicted in Appendix D, and submits it to the MDESE. The MDESE 
then determines whether the district must begin program improvement 
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activities. (See MDESE, 1991b, for a complete explanation of Missouri's 
program improvement plan.) 

Summary 

The MM AT and the First-Grade Test are criterion-referenced 
achievement batteries which may be appropriately and efficiently used to 
evaluate the effectiveness of Chapter 1 programs throughout most of the 
grade-level continuum. Both instruments meet and/or exceed the criteria 
established by the USDE (1990) for approval of state norms for use in Chapter 
1 program evaluations. Furthermore, innovative reports and procedures 
facilitate the convenient use of MM AT results for Chapter 1 purposes. The 
electronic transmission of information — from the collection of the pretest 
scores on the student answer sheets to the generation and communication of 
evaluation data and results — saves Chapter 1 personnel at the LEAs time and 
effort. 
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APPENDIX D 




DEPARTMENT OF ELEMENTARY AND SECONDARY EDUCATION 
P.O. BOX 4 80, JEFFERSON CITY, MISSOURI 6S102 
CHAPTER UESEA 
LOCAL SCHOOL REPORT 



ATTACHMENT "A M 



Whether or not attainment of an average gain of one NCE is made in basic, advanced, and overall skills, Chapter 1 regulations require 
consideration of locally developed outcomes and local conditions before a final determination is made regarding the necessity of 
program improvement activities. This form provides such information to help the local school district and the state agency determine 
if program improvement activities must be initiated. 



This form is to be completed for each Chapter 1 subject area. Include building level analysis for each building having more 
than 10 participating Chapter 1 students, grades PreK-12, regardless of whether a plus (+) one average aggregate NCE gain 
has been achieved in basic, advanced and overall skills. (If more forms are required, copies may be made.) 



School District Name 


District Code Number 







A* Locally Developed Desired Outcomes (Must address both basic and advanced skills) 



Progress toward meeting learner outcomes will be considered if local program objectives have been achieved. 

Indicate locally developed desired outcomes for schools shown on page 10 of the 1990-91 project application for each eligible 
building and Chapter 1 subject area. (A separate copy should be submitted for PreK-K-grade 1:) 

Outcome 1: 



Outcome 2l 



B. Local District Position on Program Improvement 



Depending on the strength of any supporting data, the school district is asked to identify its position with respect to program improve- 
ment for each building listed on the back of this form. 



POSITION 1 



Based on a review of program effectiveness at participating Chapter 1 schools, the building(s) identified on the back of this form are 
those which, subject to Missouri Department of Elementary and Secondary Education confirmation, are in need of a Program Im- 
provement Plan. Documentation which supports this process is maintained. The Program Improvement Plan will be kept on gle and 
be submitted to the local board of education and to the SEA. Plans for these schools are to be submitted no later than January 15, 
1992, or 60 days after official notification by the SEA. 



POSITION 2 



Local conditions identified on the back of this form which are subject to Missouri Department of Elementary and Secondary Educa- 
tion confirmation, should be taken into consideration before identifying the building(s) listed in "D" as needing a Program Improve- 
ment Plan, If documentation provided by the LEA is not approved by the SEA, a Program Improvement Plan will be submitted in 
accordance with the requirement. 



OPTIONAL 



At the request of the LEA, technical assistance in the development and implementation of the Program Improvement Plan may be 
provided by SEA staff. 

Parents of participating children, school staff and the local educational agency jointly agree that the Missouri Department of Elemen- 
tary and Secondary Education, Chapter 1 Section, be a provider of technical assistance in developing *nd implementing the local 
£ RJXT Prosrani Improvement Plan. 
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